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Delta Domain Modeling and Identification Using 

Neural Network 



Abstract — This paper proposes modeling and identification of dynamical systems in delta 
domain using neural network. The properties of delta operator are used such as greater 
numerical robustness in computation and superior coefficients representation in finite word 
length in implementation and well ensured numerical conditioning at high sampling 
frequency. To formulate the identification scheme delta operator model is recasted into a 
realizable neural network structure using the properties of inverse delta operator. 

Index Terms — Delta Operator, Neural Network, System Modeling, System Identification 



I. Introduction 

In recent years, the delta operator [1], [2 J has been widely used to many areas in systems and control. The 
delta operator establishes a special rapprochement between analog and discrete dynamic models and allows 
for investigating the asymptotic behavior of discrete-time models as the sampling period converges to zero. 
Moreover, it has certain numerical advantages compared to the shift operator parameterization. It therefore, 
provides a unified framework for system studies, where continuous-time results can be achieved from the 
discrete-time description of the system. Since 1990 there has been an explosive growth in pure and applied 
research related to neural network. During this period multilayer feed forward network was introduced and 
found applications primarily in static systems. K. S. Narendra and K. Parthasarathy [8] have demonstrated 
that neural network (NN) could be used efficiently for the identification and control of nonlinear discrete- 
time systems modeled with shift operator. Numerous models for practical identification of nonlinear 
dynamical systems were proposed by them. Following the publication of this paper several researchers in the 
last two and half decades have further reinforced the research activities with wider applications and greater 
practical importance in the area of system modeling and. In this area, the research initiatives have been more 
concentrated on the application of NN for system identification mostly modeled with shift operator [7], [9] 
to [14]. 

This paper proposes NN modeling and identification of linear dynamical systems modeled with delta 
operator to capitalize the advantages of greater numerical robustness in computation and superior coefficients 
representation in finite word length in implementation and well ensured numerical conditioning at high 
sampling frequency. The paper is organized as follows. Section // provides a brief introduction to delta 
operator. In section III, modeling and identification procedure in delta domain is described. A brief 
introduction of the concept of multilayer neural network is illustrated in section IV. In section V, the 
computational framework of NN model for delta operator system is presented for identification. Different 
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examples have been discussed with simulation results. Finally conclusion is drawn in section VI. 
II. The Delta Operator 

The delta operator is defined in the time-domain as 

«=4=i m 

A 

where, A is the sampling period and q is the forward shift operator. Operating 8 on a differential signal x(t) 
gives 

Sx(t) = X(t + A) - X(t) (2) 

A 

Similar relation exists in the complex domain as well. The transform operator y is related to z-transform by 
the following linear transform: 

z-1 

r=—r (V 
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where z = e is the complex domain z-transform operator while s is the Laplace transform operator. 

In discrete time using delta operator, an n th order single input single output linear time invariant system 

[also referred to as plant in the following sections] is represented by [3J: 
5x(t) = A 5 .x(t) + B 5 .u(t), 

y(t) = C 5 .X(t) (4) 

where As, B s and Q are matrices in delta domain state-space representation. 

pfcA; A*0 
\t; A = 9 



The independent variable t 



A: is a positive integer and X (t) = [xj(t), x 2 (t), ,x n (t)] T is the state vector with Xf(t)s [i=l,2, n], 

are state variables and u(t) Scy(t) represent the system input and output of the system respectively. The vector 
X (t) denotes the state of the system at time / and is determined by the state at time to < t and the input u is 
defined over the interval ft tj. The output y(t) is determined completely by the state of the system at time 

III. Modeling And Identification 

Consider a second order single input single output linear time invariant plant whose delta transfer function is 
given by 

Ma(r)=^\ -(5) 
y +Cy + D 

Equ. (5) can be written as 

y(t)_ Ay + B 



u(t) y 2 +Cy + D' 
or. y(t) =- Cy A y(t) -Dy 2 y(t)+ Ay A u(t)+ By 2 u(t), 
or. y(t) =ai y - ] y(t)+ a 2 y ~ 2 y(t)+ y A u(t)+ y ~ 2 u(t). 
where aj = -C, a 2 = -D, jSj = A and fl 2 = B. 
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Thus the output y(t) can be expressed as sum of gama-in verse values of input u(t) and output y(t). Again 
consider a n th order single input single output linear time invariant plant, whose delta operator representation 
is given by equ.(4). If the plant is controllable and observable then the state as well as output at any instant 

can be determined from linear combination of n gamma-inverse values, y ~ l y p (t), y ~ 2 y p (t), , y ~" y P (t) of 

y p (t) and n gamma- 
inverse values, y ~ l u(t), y ~ 2 u(t), , y~ n u(t) of u(t) where n is positive integer. Equation (4) can then be 

written as 

y P (t) = 



5^ [a i (A).y- i y p (t)J+^] =l V~ J «(*)] 



where a? (A) and fi/(A) are parameter vectors dependent on sampling period A. A neural network 
identification model for estimation of a t (A) and fi/A) of the linear plant is shown in Fig. I . 
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Fig. 1 : Neural Network Identification Model for Linear Plant 

The gamma-inverse block used in the model structure can further be realized from equ.(3) into the structure 
shown in fig. 2. 



U 



+ 




z 1 




© — + 



i) = r 1 u 



Fig2: Block Diagram Representation of Gama-inverse Operator 

In the model plant output at the time instant t depends both on gama-inverse values, y ~ l y p (t) [i=l,....,n] of 
y p (t) and gama-inverse values, y ~ j u(t) [j=l, ....,n] of u(t). 
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IV. Multilayer Neural Network 



Multilayer neural network has apparent features like learning capabilities, inherent approximation 
capabilities, massive parallelism and very fast adaptability which enable them to be used as a powerful tool 
for modeling linear as well as nonlinear functions. One advantage of multilayer neural network is that the 
complexity of unknown function can be handled by increasing the number of neurons in each layer without 
much increase in computational time of the network due to parallel processing capability of neurons. The 
structure of a multilayer feed forward neural network containing two hidden layers is shown in fig. 3 
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Fig3: A Multilayer Feedforward Neural Network with Two Hidden Layers 



The output of the i t element (neuron) in layer / is given by 



^yj- 1 + 



where [wj] are the weights associated with the i th neuron at the I th layer and the function o(): R (-1,1) is a 
monotone continuous function. Hyperbolic tangent function; tanhQ is an example of such function. 

Throughout this paper a multilayer network having n number of neurons in input layer, nj,n 2 , nu no. of 

neurons in f ,2 nd ....and (l-lf hidden layers and «/ no. of neurons in output layer is represented by 

NN nln2 _ n l-l 

A neural network, as defined above, represents a specific family of parameterized maps. If there are n input 
elements and ft/ output elements, the network defines a continuous mapping NN(): R n0 ->R nl . 
The back propagation algorithm which performs gradient descent, provides an efficient method to train a 
multilayer feedforward neural network [4] to approximate a given continuous function over a compact 
domain. In this paper multilayer backpropagation neural network is used for modeling linear time invariant 
dynamical plant capitalizing its approximating property [5] of any continuous function on a compact set in a 
very precise and satisfactory sense. 



V. Simulation Results 

For simulation purpose we have considered a second order linear plant having following model structure: 

yp(0 = fi [y ' 2 yp(0* 7 ~ 2 yp(0> y ! u(t)> y ~ 2 u(t)], t=kA for AfiO; k is a positive integer. 

Where the function fi() is a linear function of gamainverse values of y p (t) and u(t). 
For this example the unknown function is assumed to be of the form 

fi()= a y - 1 u(t) + b y - 2 u(t) - c y A y p (t) -dy- 2 y p (t) 

where a, b, c and d values are calculated from the continuous time s-domain transfer function 
y(t)/u(t) =[1. 8868s + 0.5314] / [s 2 + 1.2217s + 0.5314] 

and their values are given in table-I for different values of A. 

The function fiQ is estimated by a multilayer neural network NN 12> u having two hidden layers of twelve and 
fourteen neurons respectively. The number of neurons in the hidden layer is chosen keeping in mind that the 
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Table-I: Delta Transfer Function Coefficient Values Derived from a Continuous-time Model for Different A. 



A 


a 


b 


c 


d 


0.1 


1.8 


0.5 


1.2 


0.5 


0.09 


1.8085 


0.50305 


1.2022 


0.50305 


0.08 


1.8171 


0.50611 


1.2044 


0.50611 


0.07 


1.8257 


0.5092 


1.2066 


0.5092 


0.06 


1.8343 


0.51231 


1.2087 


0.51231 


0.05 


1.8429 


0.51544 


1.2109 


0.51544 


0.04 


1.8516 


0.51859 


1.2131 


0.51859 


0.03 


1.8604 


0.52176 


1.2152 


0.52176 


0.02 


1.8691 


0.52495 


1.2174 


0.52495 


0.01 


1.878 


0.52816 


1.2195 


0.52816 


0.009 


1.8788 


0.52849 


1.2198 


0.52849 


0.008 


1.8797 


0.52881 


1.22 


0.52881 


0.007 


1.8806 


0.52913 


1.2202 


0.52913 


0.006 


1.8815 


0.52946 


1.2204 


0.52946 


0.005 


1.8824 


0.52978 


1.2206 


0.52978 


0.004 


1.8833 


0.5301 


1.2208 


0.5301 


0.003 


1.8841 


0.53043 


1.2211 


0.53043 


0.002 


1.885 


0.53075 


1.2213 


0.53075 


0.001 


1.8859 


0.53108 


1.2215 


0.53108 



number of training examples should be larger than the ratio of the total number of free parameters in the 
neural network to the tolerable value of the mean square of the estimation error [6] . The neural network was 
trained using a random input sequences over the interval [-1 1] with time steps A as given in table-I and for 
a time interval of 60 second for each A value, considering A and gama-inverse values of boX\\ y p (t) and u(t) as 
training input and y p (t),a, b, c & d as target. 

Thus the equation using trained neural network that will govern the behaviour of the plant is given by: 
y p (t) =NN 12 ,i4 /A, y '^pft), y ~ 2 y p (t), y A u(t) s y ~ 2 u(t)], t=kA for &£0; k is a positive integer 
The trained neural network model is simulated considering sinusoidal test input sequences u(t) = sin(2nt/200) 
+ sin(27it/100), ), [ t=kA; A^0; k is a positive integer] for different values of A. Some the simulation results 
are shown in the fig.4 to fig.6 with sampling period 0.06, 0.01 and 0.005 second respectively for simulation 
intervals of 60 second each. 
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Fig4: Estimated Output of Neural Network Model for A=0.06Sec 

The outputs of the plant and their estimates are shown by dark and light coloured lines respectively. It is seen 
that the output of the plant and identification model are almost indistinguishable i.e the identification model 
approximate the actual plant with very insignificant error. 

Also the mean values and standard deviation values of estimated parameters generated by neural network in 
the simulation interval for different values of delta are given in table-II and table-Ill respectively. The values 
show that estimates are very close to actual parameter values given in table-I and converge towards 
continuous -time parameters as A — > . 
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Fig5: Estimated Output of Neural Network Model for A=0.01Sec 
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Fig6: Estimated Output of Neural Network Model for A=0.005Sec 



Table-II: Mean Values of Neural Network Estimated Coefficients 



A 


a 


b 


C 


d 


0.1 


1.8001 


0.50003 


1.2001 


0.50003 


0.08 


1.817 


0.50609 


1.2044 


0.50609 


0.06 


1.8343 


0.51233 


1.2088 


0.51233 


0.03 


1.8604 


0.52177 


1.2152 


0.52177 


0.01 


1.878 


0.52817 


1.2196 


0.52817 


0.007 


1.8806 


0.52911 


1.2202 


0.52911 


0.005 


1.8823 


0.52973 


1.2206 


0.52973 
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Table-III: Standard Deviation Values of Neural Network Estimated Coefficients 



A 


a(10" 5 ) 


b(10" 5 ) 


c (10- 5 ) 


d (io- 5 ) 


0.1 


3.516 


2.6858 


3.0542 


2.6858 


0.08 


3.2584 


2.3426 


2.6255 


2.3426 


0.06 


2.822 


1.5323 


2.1172 


1.5323 


0.03 


2.6051 


1.2354 


1.85 


1.2354 


0.01 


2.2905 


1.2944 


1.0819 


1.2944 


0.007 


3.1751 


1.3846 


1.4122 


1.3846 


0.005 


3.5032 


2.0632 


1.9737 


2.0632 



VI. Conclusion 

Delta operator representation of dynamical system provides a robust framework in identification. The 
computational advantage of neural network is capitalized to develop structural framework using delta 
operator in which backpropagation algorithm is used in model identification. The mathematical formulation 
of this model structure encompasses linear time invariant systems in discrete time parameterization. The 
capabilities of the delta operator ensure robust numerical algorithm in computation and better numerical 
conditioning at high sampling frequency which is evident from the simulation result presented in the example 
for identification. 

Therefore, from this work it is proved that neural network can be used as a candidate in modeling and 
identification of dynamical system in delta operator parameterization. 

Also the proposed scheme can be applied for identification of nonlinear dynamical system; provided real 
time input-output data of the system for different sampling period is available to train the neural network and 
maximum order of the system is priori known. 
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